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ABSTRACT 

_ This paper examines some impacts of basic skills 

proficiency testing of teachers in Arizona. A discussion of some 
legal issues involved in teacher. prof iciehcy testing is presented^ 
Specific cases are cited which illustrate. the _fact_ that the courts 
have ruled that testing must show "jbb-relatedness" and a "rational 
basis for use." It is pointed but that>, in spite bf high rates bf 
minority failure, the courts have ruled that basic skills proficiency 
testing is related to the states' "legitimate employment needs." It 
is noted that court rulings on test validation have steered states 
toward or ite r ion-referenced examinations which measure bas ic skills ^ 
prof ess ional knowledge , and con ten Arizona 
Perf o rmance- Based Teacher Cert if ica which consists of a 

basic skills subtest^ a professional knowiedg subtest, and a 
proposed competency-based two year teacher residency program, is 
described. The major focus of this description is on the Basic Skills 
subtests arid some impacts this has had on teacher education in 
Arizona. Results bf the Arizoria Teacher Prbficiericy Exam in the basic 
skills cbmpbrierit statewide ,_ and at Northerri Arizona University, are 
examined. Firially > sbmeearly testirig results are arialyzed^ This 
includes a discussion bf some test, score cbrreslati oris with, other 
measures bf student ability as well as a discussibri bf implicatibris 
for minority students. (JD) 
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TCACHER T HSTING AS - A-COm i T : ON OP £1£RT i F I C AT IGN : 
PROMISES . PITFA1> LS ; AND PRA TF AfcfcS 

Arnold _B_:_ Danzig . 
Northern Arizona University 

INTRODUCTION 

One might argue that there exists today a crisis of 
confidence in teacher education. Some have argued that 
the teacher job market collapse of the 197Gs played an important 
part in shrinking the available talent pool (Weaver, 1979) . 
Fewer job openings and the growth of opportunities and salaries 
in other fields, particularly for women, have led to a deteriorated 
applicant pool. 

One indication of decline that is often pointed to 
comes from the test results of education majors on a variety 
of standardized measuring instruments including the Scholastic 
Aptitude Test (SAT) , Graduate Record Examination (GRE) , and 
the National Teachers Examination (NTE) (see Weaver, 1979; 
Hathaway, 1980; Ivie, 1982). According to Weaver (1979) 
education majors score near the bottom on SAT Math and English 
Tests, surpassing only those in Office-Clerical and Vocational- 
Technical fields. 

Responses to this perceived decline have come from 
educators, the media, parents, the military, business leaders, 
voicing their concern over the outcomes of public education. 
In turn, state legislatures, colleges of education, and 
departments of education have begun to question and readdress 
teacher education in the various states across the United 
States : 
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The legal responsibility for public edacation has tradi- 
tionally resided with state governments. Under most state 
constitutions r the state legislature is authorized to provide 
public education in consort with the local district. 

As legislatures have become more concerned with the quality 
of education existing in the schools, they have passed legis^ 
lation requiring new programs and teacher credent ia 1 ing 
standards. Requiring competency testing for teachers in 
basic skill areas (reading, grammar, math) as well as subject 
areas has proven to be an expedient way for legislatures 
to deal with the complex problem of improving public education. 

Rubinstein et al. (1982) report that as of January, 
1982, sixteen states have newly revised programs for teacher 
certification in process or under consideration. New programs 
exist in Florida, Georgia, Louisiana, Mississipp>i , Virginia, 
and West Virginia. In 1981-1982 alone, eight other states 
have implemented major program changes while California, 
New York, and Texas are currently planning implementation 
of new programs. 

Elements of Teacher Testing Programs 

State programs vary in the number and nature of tests 
used, but most involve some combination of three basic elements: 
(1) Basic Skills testing; (2) Professional Studies Testing; 
and (3) Content Area Testing. Five states use or intend 
to use all three types of examinations : Arkansas , New York, 
Mississippi, Virginia, and West Virginia. Six others use 
or will use two of the above procedures: Alabama, Arizona, 
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Florida, North Carolina, and Tennessee (Rrabinstein et. al., 
1982) . 

In addition, some programs include a supervised teacher 
internship program as a condition of certification. Eight 
states hav^, or project to have an internship ranging from 
one to three years in length: Alabama, Arizona, Florida, 
Georgia, Oklahoma, North Cafoiina, New York, and South Caroliua 
(Kel ley, 1982; Rubinstein et all, 1982). 
Th& -Na^ ^nal Teachers Examination 

The most commonly used instrument employed by states 
involved with teacher certification testing has been the 
National Teachers Examination (NTE) , used for a variety 
of purposes in twenty-five states (Ivie, 1982;. The NTE 
is a norm^ref erenced test prepared by Educational Testing 
Service of Prinreton, New Jersey. It consists of a Common 
Examination made vp of 270 professional and general education 
questions to which three hbUrs and fifteen minutes are allotted 
and which costs the examinee a fee of $35-00 (Pearson, 1981). 
A maximum score of 990 is possible on the Common Exam. 
An additional two hours, 150 question Subject Area examination 
is also part of the NTE making for a total possible score 
of 1,980. 

Some states (Louisiana and South Carolina) have recommended 
cut-off scores on the NTE as a condition of certification. 
However, critics have argued that teacher competence is 
not a unitary trait to be measured by a paper and pencil 
multiple choice test, but a process consisting of a repertoire 
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of skills (Medley, 1981; Kelley, 1982). 

Controversy over use of the NTE has centered on two 
issues: reliability of the instrument to measure teacher 
competence and high f ai lure rate of minorities . Ivif (1982) 
found that 96 percent of students at three black institutions 
in Georgia had NTE scores below the fiftieth percentile 
compared to 49 percent of students at eleven predominantly 
white institutions. Wilson and Stoller (1981) found little 
criterion-related validity to support the use of the NTE 
science related tests. Meritt (1980) on the other hand, 
found NTE Professional education test scores to be positively 
correlated to grades achieved in certain teacher education 
courses . 

I^egai issues in Teacher Testi ng 

The courts have generally ruled that if tests are to 
be used for screeni/iy but applicants, besides adhering to 
due process law requirements, safegUjrding property rights 
by procedural fairness, and requirements against capricious 
use, tests must also abide by EEOC guidelines to meet certain 
standards of validity and specific job-relatedness (Rubinstein 
et ai . , 1982) . 

EEOC guidelines specify methods of validating tests, 
and stipulate lhat differential faHure rates must have 
a job relevant basis. violations of job-relatedness and 
validation procedures were heard in Watson v. County School 
Board- of Nansemond County , and Albemarle Paper Comp>any 
V. Moody (Hathawayr 198G; Nassif & Solomon, 1982). 
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A Virginia court ruled in i:he case of Watson ^ that 
the NTE *'as it was used" for ourpbses of retention of experienced 
teachers or dismissal of teachers was ihapprbpr ia te , since 
neither detailed job analysis descriptions, nor validation 
studies had been performed. The court in Albemarle , referring 
to the importance of analyzing the ''attributes and particular 
ski 1 Is" needed for a job r establ ished c lear criteria to 
determine whether employers' tests were in factr job related 
(Rubinstein et al.r 1982). 

Rationality Relationships 

Tests and certification requirements must also reflect 
a rational basis for use. 

In Peat .v^^ West Virginia , the court ruled that certification 
qualification for doctors, must "bear a direct relationship" 
and be "apprbpriatei to a particular profession or calling" 
i.e., show some degree of "rationality" or a show that a 
rational relatidnsilip exists- 

In Chance v. Bo^rd-^^ Examiners of -City of New York , 
New York licensing requirements, for school supervisory 
personnel ;?ere declared invalid, because they lacked job 
relevance. A disparate effect had been found on the licensing 
exam, which lacked content validity, among black and Puerto 
Rican school principals. 

Rational relationship is further i 1 lustra ted in Armstead 
V. Starkville Municiple Separate School District , Tyler 
V- Vickery, and Geor^j ia Association o'f FdUca tors , I nc , v. 
New York , In Armstead, use of GRE scores for retention 
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or hiring of school personnel was deemed " irrat.ibna 1 . 
Howe^7er, in Tyler , the court ruled that, the Georgia Bar 
Exam was not discriminatory, since it had a rational bearing, 
accepted validity, and purposeful design. The Georgia Association 
of Educations struck down the use of NTE scores for granting 
six^year certification, based on ETS testimony that the 
test was designed to measure academic knowledge, not competence 
of teachers, and that arbitrary cut-off scores could not 
be validated (Hazard et al., 1977). 
Discriminatory Intent 

The court ruled in Washington v. Davis that a written 
test for police applicants in Washington, D.C. was in constitu- 
tional violation, since it had a disproportionate black 
failure rate, and was hot shown to measure actual job performance. 
Later, the Supreme Court reversed the decision by claiming 
it could not find a racial classification for the test, 
and that the test held a "rational relationship" to job 
perf ormaiice without evidence of the intent to discriminate 
(Hazard et al . , 1977) . 

Business Neces si ty 

The requirement to show "business necessity" relationship 
is most widely noted in Griggs v. Duke Power Company where 
an employer was allowed to use employment ^ests having a 
disproportionate impact on minority applicants if the employer 
could show an absence of "discriminatory intent" and show 
a ''manifest relationship" between the knowledge required 
on the test and the employment. 



An Emer g ing Mode l o f Teacher Cert, i f i ca-t ion 

Based oh concerns and aspirations voiced by students 
and teachers, cbllege faculty and state departments of education, 
parents and legis lators , teacher unions and the courts, an 

emerging consensus for teacher education and certification 

- - - . .'^ . 

may be at hand. Such a program coniststs of at least three 

basic elements: (1) Competency-based teacher education 

program; (2) jbb-rel^ted written examinations as a condition 

of certification; and (3) active feedback and evaluation 

of instruction to include in some cases, an internship. 

Cdmpe tency-based teacher education attempts to define 

a clear criteria for teaching which can be tested and evaluated 

at a later date (Piper S Houston, 1980). Elam (1971) defines 

CTBE as bringing about learner achievement of publicly stated 

performance goals or competencies and attaining evidence 

of learner outcomes by assessing performance Under specified 

condition. The learner is guided through measureable outcomes 

with emphasis placed on professional practice in the classroonu 

Teacher testing in basic skills, professional knowledge, 

and subject expertise as a measure of quality and performance 

seems to be a favored way of prdvidina for competent teacher 

candidates. Ninety-five percent of people responding to 

a recent Gallop Poll believed that teachers should be required 

to pass an examination in their subject area (Vorwerk t 

Gorth, 1982). Orhstein (1981) reports that every state 

will enact some form of teacher accoantabt i i ty over the next 

decade . 
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Increased emphasis with on-the-job per f orinance , concern 
with performance objectives, and dissatisfaction v:ith the 
norm referenced Nat lona 1 Teacher Examination!' has led to 
the development of criterion-reference tests. Emphasis 
is placed on identification of specific learning objectives, 
knowledge and skills, determined in advance and measureable. 
Legal requirements for objective-based and job relevant 
methods of measurement also seem to be more adequately satisfied 
by such an approach. 

An example of the third aspect of teacher certification — 
active feedback on instruction can be seen in the following 
example. Brickell (1980) reports that New Jersey's minimal 
skills testing program centers on a five person team of 
professionals who visit schools where students fail to meet 
testing standards during three consecutive years. Recommenda- 
tions to improve learning and instruction are made folJov/tng 
research-based standards for- good^ ins true t ion provided by 
the NIE Regional Laboratory, Research for Better Schools. 
Four state educational improvement centers provide technical 
assistance for local schools to close the failure gap. 

The next section follows the Arizona experience more 
closely as a nurnber of possible directions and strategies 
are explored; 

Teacher Certificati on -in Arizona 

During the past few years, the Arizona Department of 
Education, responded to legislative mandate by embracing 
a comprehensive program to systematically evaluate new teachers. 




Known as the Arizona Performance-Based Teacher Cer ti f i cat i bh 
procram, it consists of a basic skills subtest, a prof es s idha 1 " 
knowledge subtest, and a proposed competency based two year 
teacher residency program. 

The major focus of this ahr.lysis is oh the Basic Skills 
subtests and some of the impacts this has had oh teacher 
education in Arizona. However, before adi^essing this issue 
in detail, it is worth describing the total program in general. 

The Arizona legislature now requires that .all new teachers, 
or teachers hew to the State, pass a proficiency examination 
in reading, grammar, and mathematics as a condition of certi-- 
ficatibn. The responsibility for test selection, administration, 
and determihatibh of passing scores was given to the Arizona 
Department of Education. 
ATPE: Basic Skills Component 

The State moved from legislative directive in April, 
1980, to full implementation of the Arizona Teacher Proficiency 
Exam (ATPE) in June, 1981, through several stages. To meet 
the legal implementation date of October, 1980, th Commbn 
Examination of the National Teachers Exam was used on an 
emergency basis. A task force set up by the Department 
of Education then evaluated previously validated test items 
in reading igrammar , and mathematics from a test bank developed 
through the Los Angeles Cbuhty Superintendent's Office and 
determined the content appropriate for use in the ATPE basic 

J 

sk i 1 Is comipbnen t - 

The ATPE is cbmprised of 150 questions, with 50 each 
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in reading, grammar, and hiathemat i ch : ftn a-hitrary passing 

score of fifty percent correct responses was established 

daring the six month norming period, to be phased upward 

in two stages, so that by January, 1982, eighty percent 

correct responses was required for a passing score. 

A'fPE: Professional Knowledge Xomponent 

in December, 1980, the Departmen^ of Education received 

a State directive to develop a professional education subtest 

to measure knowledge Of "essentiai skills." With the assistance 

of five task teams, the Department assessed what it considered 

to be the specific and essentiai professional skills that 

should be learned in teacher education programs. The result 

was a list of 73 necessary skills from six content areas: 

classroom management, curriculum and instruction, assessment 

_ / 

and evaluation, growing and learning theories, educational 

foundations, and organization and administration. Tests 

items were designed to be given as the Professional Knowledge 

subtest of the ATPE. Plans to raise the required correct 

response level to eighty percent have for the moment been 

postponed, and at the present time, fifty percent of the 

questions on this subtest must be answered correctly to 

achieve a passing score. 

A^l zxma -Teacher Residency Prograrr (7tTiU^;>- 

The third and final phase of the Arizona Performance- 
Based Teacher Certification Program authorized by state 
law, is a proposed two-year teacher residency program presently 
in its pilot testing 
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ATRP participants will have two years to demonstrate 
minimal levels of acceptabre classroom performance, as assesse'd 
by indi vidua 1 staff deve lopmerit commit tiees and an externa 1 
data collector- A four-member team, consisting of a practicing 
master teacher, a practicing school administrator, a teacher 
educator from a similarly skilled subject area, and an inde- 
pendent evaluator from outside of the school (chosen from 
State Department of Education or the university) will serve 
as the evaluation team. 

A number of instruments adapted from the Georgia Teacher 
Performance Assessment System are to be used to assess competence 
areas in the evaluation of new teachers. 

To sum, the ATPE Basic Skills subtest was designed 
as a minimal competency based examination to measure and 
assess teacher proficiency in basic skill areas of reading, 
grammar, and mathematics. 

The ATPE Professional knowledge was designed as a skill- 
based, criterion referenced examination. It was intended 
to measure specific and clearly defined classroom and knowledge 
skills required of the beginning teacher. 

The teacher resident in Arizona will have received 
a Bachelor's Degree from an accredited institution and have 
completed an approved program in teacher education. He 
or she will possess an appropriate teaching certificate, 
passed the Basic Skills and Professional Knowledge subtests 
of the ATPE, and demonstrates proficiency in classroom skills 
during a resident program, before a permanent certification 
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decision is made. 

Results of Basic Skills Testing of Arizona's Perspective 
Teacher s 

As mentibned earlier, the major focus of this study 
is to understand sbrtie of the background and impacts of basic 
skills testing Oj. Arizona teachers. This section will look 
at the results of the ATPE Basic Skills component statewide, 
as well as the test results of students at Northern Arizona 
Uni versity- 

Between July 1, 1981 and June 30, 1982, the Arizona 
Department of Education administered 1,903 ATPE Basic Skills 
exams. Of this total, 1,344 (60,6%) passed and 559 (29.4%) 
failed. Females performed slightly better than males with 
1,016 out of 1,406 (73%) passed compared with 325 out of 
488 (67%) passed. Minorities performed lower than Caucasian 
examinees to following extent: 



EXiiNJe GROUP 


PASS 


FAIL 


TOTAL 


Caucasian 


1,252 


416 


1,668 




(7 5%) 


(25%) 




Hispanics 


43 


52 


105 




(41%) 


(59%) 




B 1 acks 


9 


34 


43 




(264%) 


(73^5%) 




Native Americans 


lA 


40 


54 




(26%) 


(74%) 





Of the 1,099 exams administered to graduates of out- 
of-state colleges or universities, 839 or approximately 
76^ were passed. 
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NAU_S cores bri the AtPE Basic Skills Cdinpone nt 

According to data released by the Arizona Department 
of Education, for the period April 1 through June 36, 1982, 
102 NAU students took the ATPE Basic Skills components of 
which 60 (58.8%) passed and 42 (41.2%) failed. Females 
performed slightly better better than males with 42 out 
of 75 (56%) passed compared with 14 out of 27 (51.9%) males 
passed. Minorities performed lower than Caucasian examinees 
to the following extent: ; 

PASS FA££ 



ETHNIC GROUP 
Caucas iah 

Hispanic 

Native American 

As ian 



53 
(66.3%) 



(28 .6%) 

i 

(16%) 

i 

(56%) 



27 
(33 . 8%) 



(71.4%) 

g 

(96%) 
1 

(50%) 



TOTAL 
80 



10 



Looking at exam scores by certification field, elementary 
education majors had the highest pass rate with secondary 
the lowest. This is illustrated below: 



CEBT-fFfCATfON FIELD 
Elementary 

Secondary 



Voc. Ed, 



Special Ed 



PASS 

29 
(64.4%) 

23 
(57.5%) 

1 

(100%) 



FAIL 

16 
(35.6%) 

17 
(42.5%) 

0 

(0%) 
10 

(58 .8%) 



TOTAL 
45 

46 
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(41.2%) 

Of the secondary fields, the major with the lowest 
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pass rate was physical educatibri [7 but of 10 or 70% failed) 
and special education (10 out bf 15 or 66.7% failed). Social 
studies (3) , English (3) > and Home Ecdndmics (2) had 100% 
pass ing rates . 
Comparison of Results 

One question that needs tb be addressed is whether 
or not the data indicates a pattern bf failure significantly 
different at NAU than at other teacher training institutions 
in the State. To date^ the Arizbria Department of Education 
has not released test results broken down by institution. 
It has given each school its own scores and also distributed 
summary material for the state as-a-whole, some of which 
has been pre vibus ly ^discussed . 

The purpbse bf a comparison of results is not to judge 
the quality bf student or institution or level of instruction. 
Oh the contrary, the purpose is to suggest that without 
complete data sets, which account for incoming ability and 
other relevant variables, such comparison:^ are meaningless- 
Take for example a recent NAU Col lege of Educatibh 
News letter which compares NAU scores on specific areas bf 
the ATPE with the Statewide Average. The author cbncludes: 

It is obvious that the performance of the Nbrthern 
Arizona University is signif icant.ly. below the statewide 
average on a majority of the subskills and certainly _ 
on the total of the Arizona Teacher _Prof iciency Examination 
( Tl5e -eol lege Intercom , NAU College of Education, 
October 15, 1982) . 

Well there is really hbthihg obvious about the comparison 
at all. The number of students are not given, the significance 
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of the differences are riot merit idried . All t:[iat is given 



is a subject area subskill, the NAU avierage, the statewide 
average arid the diffeiriericie as illustrated below: 



ATPE READING 



SUBSKILL 


NAU 


STATEWIDE 


DIFFERENCE 


Main Idea 


94 . 3 


94 . 3 


0 


Subordinate Detail 


89.4 


91.8 


-2 . 4 


Cause and Effect 


8 8.2 


87 ; 9 


+ . 3 


Sequencing Events 


73 . 3 


79 . 9 


-6 . 6 


Inferred Main idea 


79 . 1 


82.4 


-3.3 


Related Events 


89.0 


90.0 


-1.0 


Predict Outcomes 


67 . 3 


72 . 8 


-5.5 


Figurative Language 


54.3 


61.6 


-7.3 


Point of View 


65 . 6 


71.2 


-5 . 6 


Fact and Opinion 


67 . 8 


74 . 4 


-6 . 6 


General izati on s 


84.0 


87 . 2 


-3 .2 


contextual Meaning 


70 . 0 


7 2 .1 


-2.1 


Synonyms 


94 . 1 


95 . 5 


-1.4 


Antonyms 


80.0 


85.7 


-5.7 


Homophones 


98 . 8 


98 . 3 


+ . 5 


Alphabetic Order 


95.0 


95 . 1 


- . 1 


Dictionary Skills 


- 9 5.6 


94 . 4 


* 1 . 2 


Table of contents 


— 8 6.2 


91.4 


-5.2 


Read Maps, Charts, 


70 . i 


74 . 1 


-4.0- 



and Graphs 



What this kind of chart does is set up the conclusion 
(as is made by the author) that NAU students are s ignif icant ly 
below the statewide average..." and that the general P'ublic 
and prospective students will view this as a reflection 
on the caliber of education within the College. 

What the chart looks like to Us is a cbritent analysis 
of the ATPE. But iristead of Usirig this data to establish 
validity of the Exam (or lack of it) , the Department of 
Educatiori releases this data so that the College of Education 
locates the blame for failure on itself. The legitimacy 
of the Examination goes unquestioned. The College of Education 
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begins l.o make changes so that they will hot look bad by 
raising admissions standards and limiting access to the 
college for students who will do poorly oh the Exarti. Appearances 
take priority over program quality and the human experiences 
of those trying to become teachers, something that has typically 
been an upwardly mobile profession for students from lower 
class or working class backgrounds, are ignored. 
Successes and Failures of NAU Students 
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As mentioned earlier^ one of the responses by the eollege 
of Education at Northern Arizona University has been to 
institute an Admissions Exam (AE) for students wishing to 
enter the Teacher Education Program. 

The Admissions Examination was based on the Arizona 
Teacher Proficiency Examination and members of the Math 
and English Departments along with College of Education 
faculty helped to make up the Exam. After revisions, the 
E:<am consisted of three sections, reading, mathematics, 
and language arts, with 50 questions each. 

To be admitted to the College, a student had to answer 
70% of the EXdm questions correctly. Additionally, a student 
must meet certain subject matter prerequisites and have 
a cumulative CPA of at least 2.5. • 

Data were collected from three separate testing dates, 
10/81, 3/82, and 9/82, in order to ascertain what the Exam 
really showed and what other factors might be related to 
Z:<an\ success. in addition to Exam scores, students were 
asked to f il 1 out a one page questionnaire concerning their 
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acaderfiic preparation: FiriaHy, on one of thd test dates, 
transcripts were obtained for students taking the Exam and 
academic achievement was compared with Exam success. 
Ii^^^-ResuLts ~ October, 1981 

The October, 198 1, testing of perspective students 
presented a unique situation because it was the only time 
that students at a field-based site were tested. With one 
or two e>:cept:ions , field-based students were Navajo teacher 
aides enrolled in a federally subsidized program in which 
courses were tr^en on site so that teacher certification 
could be achieved. 

in the October testing, 58 students were tested off 
campus while 83 students were tested on campus. 

it was of interest to knbv; what relationship might 
exist between college GPA and Admission Exam scores. The 
mean GPA for all students was 2.667 with a range from .545 
to 4.00. Fifty-eight students (40.8'f,) had GPA ' s of less 
than 2.5, the minimum prerequisite for admission to tile 
College of Education. 

Table 1 shows a high positive correlation between GPA 
and Admission Exam scores. 

TABLE I 

Pearson Product-Moment Correlations Between Student Grade Point 
Average and Scores on the Screening Examination.* 

MATH VOCABU-LAilY HEADING COMP S PELLING USAGE TOTAL 

GPA .5236 .5127 .5795 .5806 .5920 .5949 

N=141 N=140 N=14 1 N=14 1 N=14 1 N=141 

p<:.001 p<.001 p<.00 1 p<. Oei p<.G0 1 p<.001 

★This first version of the Admission Exam. had five sections and 
was made up of 190 questions. This was later reduced to 150 
questions in three sections as mentioned earlier. 
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In addition t.o being interested in i ho relationship 
bet.ween GPA and Exam score, one of the hopes of the College 
of Education was that increasing GPA requirements would 
reduce the number of failures on the Admission Exam (and 
on the r^rizona Teacher Proficiency Exam) . 

To test this assumption, the sample was divided into 
two groups on the basis of GPA (2.5 or above and below 2.5). 
This was then cross- tabulated with Exam score (pass or fail). 
The results are represented below. . 



TABLE 2 
GPA 

2.5 or Above Below 2.5 



A P 

P _ A 

ME S 

IX S 
S A 



71% (59) 


34.4% (20) 


2 9 % (24) 
1 .. — ^ 


55.66 (38) 



100% (83) 100% (58) 

N = 141 

ehi Square = 18.565 
df = 1 
p <. 00 1 

Table 2 suggests that GPA is associated with success 
on tjie Admission Examination. 

Also of interest was the difference in Exam success 
of students on campus and those at t:he field^based site. 
Whereas, 81^ of those taking the Exam on campus passed, 
this was true for only 18:9% of those at the field^based 
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site. Since the vast magbirity of this lattei?r wero Navajo 
students, this suggests a failuiris irate of such magnitude 
to cause spiscial concern fbir this Native American student; 

One final interest concerned the extent of f ai lure 
of students on campus with CPA's of at least 2-5 or above: 
Controlling for these variables, bile finds that 15% of the 
students meeting these twb criteria still failed the Admission 
Examinatibn, a significant number of students. 

Test Results t4a-xch^-13a2 : 

Between October, 1981, and April, 1982, the Admission 
Exam was given five times. Revisions were made in the Exam 
which reduced the number of questions to 150 in three sections 
reading, mathematics, and language arts. 

Thirty people were tested during the March period . 
in addition, each person was asked to fill out a one-page 
questionnaire concerning demographics and past academic 
-performance . 

Students were asked to evaluate their own ability in 

mathematics and English on a scale from 1 to 5 (A to F). 

The results are listed below. 

SELF-EVALUATION IN MATH SELF-EVALUATION IN ENGLISH 

A = 7 A ^ 8 

B = 14 B ^ 12 

C = 8 C = 10 

D = 1 

It v;as of interest to know whether these se 1 f -eva lua t i dns 
correlated o>ignif icant ly with studer ^ scores on the Admission 
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Examinat-idn. Table 3 indicates a high positive corrGlatibn 
between student se 1 f -eva 1 ua t ion and Admission Examination 
score . 

TABLE 3 

Pearson Product-Moment Correlations Between Student Self- 
Evaluations and Admission Exam Scores. 



MATH 
SCORE 


READING 


LftNSUAGE ARTS 
SCORE 


.6517 


. 5585 


.4620 


N = 30 


N=30 


Ns30 


p<. DDI 


p <. 002 


p<. 005 


. 4823 


. 5753 


.4190 


N = 3D 


N = 30 


N = 30 


p<. DD3 


p<.001 


p <. 0 2 



Self-E valuation Math 



Self -Evaluation English 



Table 3 suggests two things which are important- First, 
students do seem to be able, with some degree of accuracyr 
to evaluate their own proficiency in English and ma them--^ ' ics - 
Given time and proper counseling or advisement, these students 
might well choose to seek the help or remediation necessary 
to pass the Admission Exam. 

Second r student se 1 f -eva 1 ua L ion in math and math score, 
had the highest correlation. Math proficiency, therefore, 
seems a good predictor of Exam success. 

In terms cif actual scores on the Admission Exam, 16.6% 
(5 out of 30) students failed to answer 701 of the questions 
correctly. Taken by section, four students failed the Reading 
section, six students failed the Math section, ;and four 
students failed the Langueige Arts section (failed to ansv/er 
70% of the questions in each section correctly) . 

Of the five students failing the Exam, four failed 
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all three parts of the jlxam. One studcra failod the Matii 
section with a score so low as to fail the entire Exam. 
Finally, one person passed the Exam but failed the Reading 
section if considered separately. 

It would seem advisable for the College of Education 
to consider each section of the Exam separately, and make 
recommendations to students failing a particular section 
rather than consider the Exam as' a. whole. This is suggested 
even though the State considers only the total Exam score. 
For one thing this would give more selective advice to 
the student. For another thing, the State can ur.y time 
choose to consider ear-h section of the ATPE separately. 

One piece of information which might shed light on 
the separateness of each section of the Exam might be to 
Took at the correlations between sections. This is presented 
in Tabio 4 be low . 

table! 4' 

I n t >^ r colore la t io n Among the Thr ee S actions 
" 'of the Admission Examine tion 



READING 



R EADING MATHEMATICS LA NGUAGE -AR T S 

.8510 . 7544 

P .001 P -001 
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MATHEMATICS '> .: . 8020 

LANGUAGE ARTS . 

This suggests that the secj^ions of the Admission Exam 
are significantly and positively correlated with each uthei . 
It also suggests high internal consistency and reliability 
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to the Exarri. 

Finally, it was nf interest to know the rGlationship 
between ethnicity and Exam success. Broken down by ethnicity 
and Exarn success, the results are as follows: 

P ASS EXm FA IL EXAM 

Caucasians 22 2 

Native Americans 0 3 

Hispanics 2 0 

Orientals _J: 

2 b ' 5 
N = 30 

Again, this indicates a pattern of minority failure to reach 
required levels of proficiency in basic skills as measured 
by the Admission Exam. 

Test Resu it :s - September, 1982 

In September, 1982, seventy-one freshmen a^>d Rop'nomore 
^^tudents enroUed in Introduction to EdMcatlon were given 
the Admission Exam. Of this group, 25% we-e males and 7:;- 
were females, and the mean GPA was 2.921. Fifty-seven student 
identified themselves as: Caucasian, ten as Mexican Anioricans 
or Spanish-speaking, and four as Native Amer i^^ -ins - 

Students were asked to report on their high school 

GPA and their self-report: is listed beiov;. 

HIGH SCHOQI.- GPA 

A = 18 
B = 37 

e = 15 

D = 1 

N = 71 



liiqh school average ( se 1 £ - r epor tied j was t.heh tabulated 
with the results of the Admission Exam with the following 
dutcbme : 

ADMISSION EXAM 



PRSS 


FAIL 


18 


D 


34 


3 


1 3 


2 


0 


1 



A 
B 
C 
D 



HIGH SCHOOL 
GPA 



(SELF-REPORT) 



Chj Square = 12.962 
df =_ 3 
P .01 

This would suggest that high school GPA presents a measure of 
student strength and weakness which is pai'alleled by the 
Admission Exam scores, and that students are able to acc^urately 
report on their own records. As expected, hi^h GPA is assdciated 
with Exam success. 

With regard to Exam success and ethnicity, the following 
pattern was found. 

- - - AD-MISSION EXAM 



PASS 


FAIL 




54 


3 


CAUCASIANS 


3 


1 


NATIVE AMERICANS 


8 


2 


HI SPAN ICS 


65 


6 





This shows that six students (8;5%) failed the Admission 
Exam. This lower percentage (compared with previous testing 
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dates) may be att.ribuLod \/o the fact this \<iur. the first, t.estinq 
of the year and less able students might not have been as 
inclined to take the Exam at the first opportunity. The 
view is supported by the high mean GPA of the group (2-921). 
Still, of the six students that failed the exam, half were 
from minority ethnic backgrounds. 

One other piece of information which might be used to 
predict student performance of the Admission Examination 
is ACT scores. From an earlier test date (September, 1981) 
ACT scores for thirty-five students were found and correlation 
coefficients computed using the ACT Academic Tests with the 
Admission Exam subsections. These results are presented 
in Table 5. 

TABLE 5 

Correlation Coefficient between scores on the Admission Exami- 
nation eind ACT Academic Tests 

'act ACADf-MIC TESTS 



MATH 



VOCABULARY 



READING COM- 
PREHENSION 



SPELLING 



USAGE 



TOTAL 



ENGLISH 
USAGE 


MATHEMATICS 
USAGE 


SOCIAL STUDIES 
l^EADING 


NATURAL SCIENCE 
READING 


. 43 70 


. 5890 


. 2593 


. 1 550 


N=35 


N = 3 5 


N= 35 


N = 35 


p<. 005 


p<. 001 


p < . 0 5 


p<. 05 


, 6580 


; 6053 


. 494 1 


. 3005 


N=34 


N=34 


N=34 


N = 34 


p<. 001 


p<. 0 01 


p<.001 


p <. 05 


. 6289 


. 50?9 


. 6004 


. 3533 


N=^34 


N ■ 3 ^! 


N- 3 4 


N-34 


p<.001 


p <. 001 


p <. 0 0 1 


p <. 02 


. 5062 


.2733 


. 3000 


. 2002 


N=34 


N=34 


N=34 


N=34 


p <. 001 


p<. 05 


p<. 04 2 


p < . 0 5 


. 5798 


.3314 


.2915 


.1881 


N=34 


N=34 


N=34 


N=34 


p < 0 0 


p<:. 003 


p<:. 047 


p<:. 05 


; 7676 


; 6096 


. 5628 


. 3537 


N = 3 4 


N=34 


N = 34 


N = 34 


p <; G0i 


p<; 001 


p<;dOi 


p <. 0 2 



ERIC 



74 - 



26 



The result.s present. ed i ii Table 5 suiggest. that ACT scores tm.-.l 
Admission Exam scores are highly correlated. In particular, 
the English and Mathematics Usage sections of the ACT are 
strongly associated with the Admission Exam Total scores. 
Summary 

The purpose of this research was to examine some of 
the impacts of basic skills proficiency testing in Arizona. 
What emerges from this work is an understanding of some 
of the promises, pitfalls, and pratfalls, associated with 
the Arizona experience. 

Teacher testing, as a condition of certification, grew 
out of a perceived decline in the teacher applicant pool 
and a general concern with the quality of education. Teacher 
testing was one legislative response to these concerns. 

The courts have ruled that testing must show "job- 
relatedness" and a "rational basis for use." In spite 
of high rates of minority failure, the courts have ruled 
that basic skills proficiency t.esting is related to the 
"legitimate employment needs" of the state. Court rulings 
on test validation have steered states towards criterion- 
referenced examinations wh.ich measure basic skills, professional 
knowledge, and content area ability. 

Ar zona has moved through a h Umber of st.ages in the 
implemeni ation of a teacher certification program which 
now includes a Teacher Proficiency Examination, Basic Ski its 
and Professional Knowledge components. Also proposed is 
the use of a two year residency program now being piloted 



i six dist rict::? in the State. 

baring the six month period beginning January 1, 1982, 
i/Sd5 Exams were administered by the Arizona Department, 
of Education of which 1,344 (70.6%) passed the Basic Skills 
component at the required 80% proficiency level. Minorities 
performed at a much lower rate of the 193 Exams administered 
to blacks, Hispanics, and Native Americans, 66 (34.2%) 
pas sed . 

Results for the field test period (50% correct responses) 
on the Professional Knowledge component show that 97% passed. 

One response of the College of Education at Northern 
Arizona University has been to institute an Admission Exam 
to screen applicants. One of the conclusions of this analysis 
is that large numbers of students are failing this Exam. 
Of the 242 student scores examined in this studyr 73 (30%) 
failed at the required proficiency level, 76% of the questions 
answered correct 1 y . 

A second conclusion from the Admission Exam data is 
that large numbers of minority students are failing the 
Exam. Of the 78 blacks, Hispanics, and Native Americans 
tested, 53 (67.9%) failed. This has dismal implications 
for minority students and for the number of minority candidates 
completing teacher education at Northern Arizona University 
and qualify ing for certification in Arizona. 

in addition, high positive correlations were fbUhd 
among the scores on sections of the Exam as well as Exam 
scores and other measures of academic ability and achievement. 



iiicjh school cind cbllcqo CPA, ACT scores, and studcMit. solf- 
evaluation in maLh'emat ics and English were ail significantly 
and positively associated with Exam scores. 

The consistency of failure across so many different 
measures of ability and achievement suggest to this researcher 
that minority students may well find themselves penalized 
for their ethnic and cultural backgrounds. Without special 
help and remediation, a valuable resource, the representatives 
of minority cultures, will be lost to the school s of Ar izona . 

Fina 1 ly , the high positive correlation between student 
self-evaluation and Exam scores indicates that 
students are able to recognize their own strengths and 
weakness in preparation and accomplishment. 
Recommendations^ 

Since students must take the Arizona Teacher Proficiency 
nxamination anyway, and pass at the 80?. proficiency level, 
it would make more sense to allow students to take tho 
Hasjc Skills component as the Admission Exam rather than 
a separate, locally prepared, and possibly easier test. 
And although the State considers the ATPE as a whole (80% 
of the 150 questions mUst be answered correctly regardless 
of how one does on a particular section) it would provide 
greater diagnostic help if the grammar, reading comprehension, 
and mathematics sections were considered separately. Fai lure- 
in one rirea could then lead to remediation. 

The responsibility to provide necessary remediation 
must come as early as possible in the student's academic 



career. the question of whose rospbris i b i 1 i t y t.hi^ is, 
the College of Education's or bt-her aCcidemic divisions', 
should not be the issue. 

It is recommended that thie University form a center 
for the development of b:isic skills to meet the immediate 
needs of students and potential teachers^ The ultimate 
relationship among high schools, community colleger, and 
universities iri teaching basic skills, can then be addressed 
in reaching a long range solution. - 

Finally, advisement of undergraduate students is an 
area of key concern. Data must be collected on a regular 
basis from which informed decisions concerning proper sequence 
and level of coursework can be made^ For example, if students 
score below required levels on the mathematics section 
of the Exarn, they would be required to seek remediation 
before entering what are nov/ the required inath courses. 
This will require additional time and courso requirements 
for the student. However, passing students from one course 
to the next, without the development of the required basic 
skills, serves neither the student nor t.he University. 
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